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The purpose of the Academic Administration 
Internship Program is to enlarge the number and to improve the 
quality of persons available to fill key positions in academic 
administration. The urogram was designed to meet the following 
objectives: (1) to identity qualified people; {2) to select the most 

promising among those identified; and (3) to provide the selectees 
with experiences that would develop their potential to perform 
effectively in administrative positions directly related to academic 
areas* After briefly discussing the results of prior research on 
nomination, evaluation and selection, this report: deals mainly with 
the results of the Career Status Followup Study, which included the 
sending of a Career Status (C3Q) to 106 former Fellows and 106 former 
nominees who did not receive the internship^ In addition, the CSQ was 
sent to 83 participants in the ACE Academic Deans’ Institutes in 1967 
and 1968- The results indicated that there was a high intrinsic 
correlation between selection and experience as a Fellow and early 
attainment of a career position as an academic administrator* Some 
findings were also made regarding: (1) the nomination stage, (2) the 

dossier evaluation stage, (3) the interview stage, and (4) the 
internship experience. (AF) 
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and institutions. Its purpose is to advance education and educational methods through comprehen- 
sive voluntary and cooperative action on the part of American educational associations, organiza- 
tions, and institutions. 

The Council's Office of Research was established in 1965 to assume responsibility for conduct- 
ing research on questions of general concern to higher education. ACE Research Reports are 
designed to expedite communication of the Office's research findings to a limited number of 
educational researchers and other interested persons. 
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Goals and Achievements of the ACE Internship Program in Academic Administration 



The Academic Administration Internship Program of the American Council 
on Education was established in 1964 under a grant from The Ford Foundation. 

The purpose of this program is to enlarge the number, and to improve the 
quality of persons available to fill key positions in academic administration. 

To fulfill this purpose, the program was designed to meet the following specific 
operating objectives: (1) to identify qualified people, (2) to select the most 

promising among those identified, and (3) to provide the selectees with exper- 
iences that would develop their potential to perform effectively in adminis- 
trative positions directly related to academic areas. 

Concurrently with the operational program, the ACE’s Office of Research 
has conducted a program of research on various aspects of the operational 
program, particularly on the question of how well it is implementing its 
objectives. Although the small scale of the operational program limits the 
value of the research results, much useful information has been obtained and 
is documented in four previous reports, all of which provide considerable 
evidence that the program goals are being achieved. The previous studies 
dealt with the characteristics of participating institutions, the charac- 
teristics of nominees, the progress of nominees through the processes of 
evaluation to the point of their final selection as Fellows, and on their 
progress during the internship experience. The present report is focussed 
on the career status of Fellows, as compared with those nominees who were not 
selected, from one to three years after completion of their internship. 

Only at this point is it possible to determine more nearly whether the ul- 
timate program goals are being achieved. 

To lay a general foundation for the present report, a brief descrip- 
tion of the program and of prior research results will precede the discussion 
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of the followup study of career status. 

Previous Documen ta t ion on Nomination, Evaluation, and Selection 

The four previous reports, as well as the present one, are based on 
research done on the first three years of the program. Cox (1966) described 
the objectives and initial operating structure. Astin (1966) presented the 
initial research results from the first year of the program, concentrating 
on the characteristics of participating institutions, the nominees, the 
evaluation and selection process, and the selected Fellows. Creager (1966, 
1971) presented similar information for the second and third years of the 
program, respectively, comparing the results obtained for each of the three 
different classes. The last of these reports included information, not 
previously published, on the evaluation of nominees by their home institu- 
tions and on the immediate po° tin ternship evaluations of the Fellows and 
their in tern .ship experience. 

Wherever feasible, relevant control groups were used to provide 
comparative information. For example, nominees have been compared with 
faculty members who reported having no interest in academic administration, 
and Fellows have been compared with deans and other academic administra- 
tors who had already assumed positions of academic leadership. Moreover, 
at each stage of evaluation, Fellows have been compared with nonw inner s . 

With minor variations the evaluation and selection procedures were 
highly similar during the first three years of the program, and the research 
results were generally consistent. In each class year, the presidents of 
the member institutions of the Council were asked to nominate a person con- 
sidered to have outstanding promise for a career in academic administration. 
Participation by public institutions and universities had been proportionately 
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greater than that by liberal arts, two-year, and church- re la ted colleges, 
or by techni-cal institutions. 

The presidents were also asked to choose three persons familiar with 
the nominee and have them complete a structured evaluation form consisting 
of a set of ratings on their nominees. These Home Evaluation ratings con- 
tained unique and relevant information and were made a part of the dossier. 

They were of special value in that raters at the home institutions had ob- 
served the nominee over a period of time, and in several situations, in con- 
trast to those who provide ratings in later stages of evaluation. 

Each nominee submitted a dossier consisting of a letter of recommen- 
dation from the nominating president, graduate and undergraduate transcripts, 
an application form, and an essay on an assigned topic dealing with academic 
administration. The dossiers were initially screened by the staff of the 
Internship Program for administrative reasons and then evaluated by four-man 
teams composed of members of the professional staff of the Council. This 
^valuation resulted in an overall Dossier Rating, one from each judge, as 
Outstanding, Good, Acceptable, Doubtful, or Unacceptable as potential 
academic administrators. The data from the dossier* were also used to charac- 
terize the nominee groups and to study the parts of the dossier that most 
greatly influenced the Mean Dossier Rating. 

Beginning with the fourth year of the program, certain changes were 
introduced. The participating institutions were invited to establish and 
support internships on their own rumpuses or at a host campus. The evalua- 
tion and selection of Fellows is similar to the pattern followed in the first 
three years, with preference being given to potential academic officers, 
such as academic deans and vice presidents, in contrast to admissions and fis- 
cal officers. The results of research on the first three classes are therefore 
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re levant to the continuing program. 

The nominee is likely to come from the ranks of faculty. He may 
hold his highest degree in any one of a broad range of academic disciplines. 
However, nominees are much more likely than the typical faculty member to 
have had some administrative experience, and to be more self-confident, 
outgoing, and socially act e. The more recent nominee seems to possess the 
characteristics, aptitudes, and attitudes that are judged to be most impor- 
tant in the evaluation and selection process. This trend in the character- 
istics of the nominee group occurred primarily between the second and third 
year, at a time when program objectives and desired characteristics of nomi- 
nees had become more clearly defined. Evaluators of the dossiers seem to 
place the greatest emphasis on the nominee’s past scholarly achievements 
and on the ratings he receives from his home institution on personality 
traits and on acceptability as a dean. 

In the first year of the program, all nominees were interviewed by 
teams consisting of college presidents and members of the executive staff 
of the Council. These interviews, which constituted a second stage in the 
evaluation process, resulted in an additional set of ratings of nominees 
prior to final selection or rejection. Astin (1966) found that the Mean 
Dossier Rating was a good predictor = .66) of the final Overall Rating 
from the interview, so that the dossier evaluation came to be used as a 
prescreening device, reducing the number of persons to be interviewed and the 
costs involved in the interviewing process. The relationship on which this 
decision was based has held up rather well in subsequent years (correlations 
are estimated to be in the .50-. 60 range). The differences between the 
dossier and the interview evaluations were great enough, however, to provide 

ERJT 



1 r ' 



- 5 - 



some justification for retaining tlie two-stage evaluation procedure. The 
interview evaluations emphasize intellectual skills and personality traits 
as expressed in direct personal confrontation, in contrast to the less 
direct picture presented by the self-reports and ratings in the dossier. 

Consistently, those nominees finally selected have been more likely 
than nonwinners to hold a doctoral degree, to receive higher salaries, to 
have produced some scholarly publications, and to show a stronger interest 
in academic administration. The Fellows are also more like deans and other 
academic administrators in these respects than are the nonwinners. Similar 
differences were found between nominees and faculty control groups in these 
characteristics. In short, the Internship Program has been successful in 
achieving the first two of its objectives: to identify, and to select, 

qualified persons with potential for development into academic administra- 
tors . 

Moreover, the previously reported findings gave support to the 
tentative conclusion that the third operational objective -- providing 
selectees with experiences that will aid in their development as academic 
administrators -- was also being achieved. This conclusion is based not only 
on reports by the Fellows themselves about their internship experience but 
also on confidential reports -- evaluations of the Fellow's growth and per- 
formance during the internship year made by the mentor and others at the 
host institution who are in a position to observe that performance. These 
sources of information have yielded consistent results regardless of program 
year . 

According to reports by former Fellows, the internship experience 
provided them with wider professional contacts, enabled them to learn new 
administrative techniques, gave them experience in new problem areas, and 
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deepened their understanding of the interrelationships among administrative 
problems. Moreover 3 they developed greater insight into national problems 
and their interface with higher education, a deeper personal philosophy of 
higher education, and a more complete self- insight . The data indicate that 
these benefits come primarily through contacts and discussions with mentors, 
administrators, and faculty, and through opportunities to observe adminis- 
trative operations. The host institution benefits as well, in that the 
intern performs staff studies and other services, and often brings a fresh 
perspective to institutional problems. 

This brief summary of the operational structure of the program 
during its first three years, and of the results of prior research, pro- 
vides background for the career status followup study. Although the results 
of prior research were strongly indicative that program objectives are being 
met, examination of the later career status of nominees, in which the selected 
Fellows are compared with nonwinners, provides a stronger test of program 
success. Moreover, some of the resulting information may suggest possible 
improvements in the program. The major question to be answered by the 
followup study is: are those who are selected and who have the internship 
experience more likely to be in positions where they function as academic 
administrators than are the nonwinners? 

The Career Status FoLLowup Study 

A longer range followup study in which sufficient time has elapsed 
for career progression patterns to have been established should provide the 
kind of criterion information necessary for external validation of the evalua- 
tion and selection procedures and of the internship experience itself. Al- 
though five years after the internship period might be a more reasonable 
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point in time for the followup of each nominee group, it was judged desirable 
to reduce the time lag allowed for former Fellows to achieve career status. 
Moreover, since the respondent group was expected to be small, it was decided 
to form the followup sample by combining the nominees for the first three 
years of the program (1965-66, 1966-67, 1967-68). Accordingly a Career 
5?tatus Questionnaire (CSQ) was mailed to 106 former Fellows and to 106 former 
nominees who did not receive an ACE internship. In addition the questionnaire 
was sent to 83 participants in the ACE Academic Deans' Institutes in 1967 
and 1968, who were regarded as constituting a relevant comparison group. 

No attempt was made to follow-up those faculty members who had participated 
in earlier studies as members of control groups. The presumption is that 
this group remains predominantly engaged in teaching and research and has 
little interest in playing a major role in academic administration. The 
predominant focus in the followup was one of comparing former winners with 
nonwinners and to use the data supplied by deans as the reference for com- 
parison of achievement of reLevant career status. 

Usable returns were obtained from 90 percent of the former Fellows, 

57 percent of the nonwinners, and 82 percent of the Deans 1 Institutes par- 
ticipants. Although it is typical that the nonwinners in a selection pro- 
gram are less likely to respond to mail followups, the difficulty is com- 
pounded here because addresses of Fellows and Deans have been kept up to date, 
but those for the rejected nominees were essentially the ones obtained at 
nomination . 

The Career Status Questionnaire (CSQ), administered in the fall of 
1969, elicits information on changes in academic positions from those held 
five years ago, and three years ago, to the one presently held. It also 
contains items on how frequently the respondent was involved in various areas 
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of decision making in academic affairs, the percent time soent and degree of 
personal interest in various academic problem areas, salary information, and 
participation in a small group of related activities. A copy of the ques- 
tionnaire will be found in Appendix A. 

For each followup group the numbers and percentages of persons holding 
various academic positions over a period of time are presented in Table 1. 
Because these positions often carried faculty status and were not in other 
ways mutually exclusive, especially in small institutions, the percentages 
generally totaled more than 100 percent. Both the positions held at the. 
time of the survey and changes over time indicate that program objectives 
are being met. Relatively more former Fellows were currently in academic 
administration, but more nonwinners were in faculty positions and depart- 
mental chairmanships. Eight of the nonwinners (i.e., 13 percent) reported 
that they had participated in academic management development programs under 
some other sponsorship. Four of these have become academic deans or vice 
presidents, one a development officer and one an official connected with 
academic administrative matters in a state department of higher education. 
Practically all academic deans are still deans or have become academic vice 
presidents . 

The total sample of 155 former nominees was divided into two groups 
according f~ whether their current positions are consistent with program ob- 
jectives. This division was later refined to take into account additional 
information about their functions. The classification was clear for those 
respondents checking explicit categories; however, 21 percent of the former 
Fellows reported that their current position was "other or none." Special 
investigation revealed that over one-half of this group was in academic ad- 
ministration, but had titles not exactly fitting the explicit response 
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categories on the questionnaire: e.g., administrative assistant to the 

president, graduate dean, assistant graduate dean, assistant academic dean, 
and director of a special academic program. The remainder included two 
directors of research, the trustee of a small college, two in institutional 
research, one currently with the U. S. Office of Education, and one affiliated 
with a regional association of colleges. 

With this resolution of the ’’other or none" respondents to the cur- 
rent position item, and their addition to the two groups defined by those 
checking explicit categories, we find that 54 percent (84 out of 155) of the 
total sample of former nominees have become academic administrators. Since 
it is unlikely that such a percentage of the faculties from which nomina- 
tions are made would have become academic administrators in such a short 
time, it is apparent that the initial nominations by the presidents have 
already been helpful in identifying qualified persons. With this base rate 
of achievement of career status as an academic administrator in the total 
nominee group in mind, it is even more striking to note that 76 percent 
(72 out of 95) of the former Fellows, but only 20 percent (12 out of 60) 
of the nonwinners became academic administrators. Thus, it is obvious that 
the subsequent evaluation, selection, and internship experience of the Fellows 
serves the goals of the program. 

Even without the refinement of resolving the "other or none" category 
for positions held at earlier points in time, Fellows and nonwinners were 
quite comparable five years earlier in their distribution among positions 
and are now quite different with much more shifting of the Fellows into the 
administrative categories. Moreover, the distribution of former Fellows into 
currently held positions resembles that of the deans, who are relatively young 
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CSQ respondents were asked to indicate whether they participated in 
certain areas of academic decision making frequently, occasionally, or rarely. 
The mean response for each group in each of the specified areas is presented 
in Table 2. The pattern is congruent with that for positions held. Former 
Fellows and Deans participated more frequently xn decision making in these 
areas than did nonwinners except in the area of deciding about individual 
course content where the nonwinners (still mostly teaching faculty) played 
the greater role. Even though the deans participated more frequently in 
decision making than did the entire group of nominees, in all areas the mean 
frequencies for Fellows lie between those of the nonwinners and those of the 
Deans . 

The functions currently carried out by the CSQ respondents were 
examined in terms of the mean percentage of time spent and the mean level of 
personal interest or concern in each of 16 problem areas (Table 3) . Former 
Fellows were more similar to the Deans than to the nonwinners; they spent 
more time and expressed more interest in all administrative matters, while 
the pattern was reversed for teaching and research. 

AH but five CSQ respondents (two fellows and three deans) answered 
the question about annual salary* before taxes and exclusive of fringe 
benefits and consulting and lecture fees. Frequency distributions of 
reported salaries with medians for all three groups are presented in Table 
4. Not only were former Fellows making a higher median salary, approaching 
that of the Deans* than were the nonwinners, but the difference increased 
from what it was when both groups were nominees. As nominees the overall 
differential was about $1400 a year but had nearly doubled to $2600. This 
pattern was not completely uniform for all three classes; nevertheless, the 
picture is striking for the pooled followup group. To be sure, increased 
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Table 2 



Mean Frequency Levels of Participation in Dec is ion-making a 
(N = 223 Respondents to CSQ) 





Area of Decision 


Fellows 

(N=95) 


Nonwinners 

(N=60) 


Deans 

(N=68) 


S ignif icance^ 
S umma r y 



Admissions Policies 


1.96 


1.73 


2.24 


d/f & NW 


Faculty Policies 


2.31 


2.22 


2.87 


D/F & NW 


Financial Affairs & 
Capital Improvements 


2.07 


1.77 


2.53 


D/F & NW, F/NW 


Student Affairs 


2.09 


1.95 


2.15 


(NSD) 


Formal Public & 
Alumni Relations 


1.75 


1.63 


1.91 


(NSD) 


Individual Course 
Content 


1.95 


2.27 


1.81 


f/nw, d/nw 


Curriculum Structure 


2.43 


2.37 


2.66 


D/F & NW 



frequency Levels are: 3 — Frequently 

2 - Occasionally 
1 = Rarely 

b Di f ferences significant at the .05 level, d/f & NW indicates that 
deans differ significantly from Fellows and nonwinners. NSD indicates 
there was no significant difference. No significant differences were 
found between Fellows and nonwinners on these items, but differences favor 
the Fellows. 
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Table 3 

Mean Percentage Time Spent and Mean Level of Personal Concern and 
Interests in Various Academic Problem Areas 3 
(N - 223 Respondents to CSQ) 







Mean Percent 


Time 


r 


Mean 


Level of 


Concern 




Problem Area 


Fellows 


Nonwiniiers 


Deans 


Signif . 


Fellows 


Nonwinners 


Deans 


_ . . - b 

Signif . 


Faculty Relations 


12 


7 


19 


D/F/NW 


2.43 


1.92 


2.81 


D/F/NW 


Budget 


8 


4 


10 


d/nw,f/nw 


2.08 


1.67 


2.29 


D/NW 


Curriculum 


9 


7 


13 


d/f , 1 


2.34 


2.27 


2.74 


d/f, nw 


Physical Plant 


2 


1 


3 


D/NW 


1.23 


1.27 


1.54 


D/F 


Public Relations 


3 


5 


4 


NSD 


1.72 


1.67 


1.90 


NSD 


Student Unrest 


5 


2 


4 


D/NW, F/D 


2.07 


1.62 


2.16 


d/nw ,F/ m 


Other Student 
Problems 


3 


4 


3 


NSD 


1-51 


1.47 


1 .72 


NSD 


Development and Fund 
Raising 


2 


2 


2 


NSD 


1.41 


1.12 


1.41 


NSD 


Financial Aid 


1 


1 


1 


NSD 


1.36 


1.40 


1.29 


NSD 


Alumni Relations 


1 


1 


2 


NSD 


1.19 


1.25 


1.43 


NSD 


Adminis trative 
C oord ina cion 


14 


11 


16 


D/NW 


2.26 


2.08 


2.59 


d/f, NW 


Institutional Research 
& Program Planning 


9 


6 


6 


NSD 


2.22 


1.92 


2.37 


D/NW 


Teaching 


14 


25 


5 


d/f/nw 


2.07 


2.20 


1.90 


NSD 


Research 


5 


9 


2 


D/F/NW 


1.86 


1.90 


1.65 


NSD 


Research Admin- 
istration 


3 


4 


1 


d/nw 


1.35 


1.52 


1.09 


d/nw 



levels of Concern and Interest: 3 = High 

2 = Med ium 
1 = Low 



Significance comments; see footnote b of Table 2 for explanation. 
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salaries are not, per se, an objective of the program, but they do suggest that 
thoee who participated in the ACE internship program are recognized and re- 
warded for their worth. 

The various activities of the different groups are _ resented in 
Table 5. With the exception of civic affairs, where nonwinners were more 
likely to be active than were the Deans and the Deans in turn more active 
than former Fellows, the Fellows and Deans again were similar in the per- 
centages who reported engagement in a given activity. However, more of the 
Fellows than Deans reported giving lectures for remuneration, serving as 
consultants, and having published articles or books on administrative policy 
issues in higher education. With respect to lecturing, consulting, and 
publishing -- academic activities where communication serves the formation 
and dissemination of policy -- the Fellows were significantly more active 
than the nonwinners. It is interesting to note that some former Fellows 
have already served as mentors to subsequent Fellows. 

"Hits 11 and Possible n Misses" 

The patterns shown in Tables 1 through 5, with respect to differences 
in the positions, roles, functions, and activities of former Fellows and 
nonwinners, were markedly consistent, indicating not only that program ob- 
jectives are being met but also that these differences are pertinent to 
academic administration, as measured by the greater similarity of career 
status of Fellows to that of the Deans. But are these differences primarily 
attributable to the effectiveness of evaluation and selection procedures 
or to the ACE internship experience, itself? The evidence indicates that 
both play an important role. The greater visibility of Fellows may also 
be a factor in their more rapid progression into academic administrative 
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Table 4 

Salaries Reported by CSQ Respondents 
(N = 223) 



Salary 




Fellows 

(N=95) 


Nonwinners 

(N=60) 




Deans 

(N=68) 


f 


% 


Cumula- 
tive % 


f 


% 


Cuinu', 
tive % 


f 


% 


C umu 1 a - 
tive % 


Less than $10,000 


1 


1 


1 


0 


0 


0 


1 


1 


1 


$10,000-$14, 999 


12 


13 


14 


16 


27 


27 


3 


5 


7 


$15,000-$19, 999 


38 


41 


55 


25 


42 


69 


21 


32 


40 


$20,000-$24,999 


30 


32 


87 


15 


25 


94 


23 


35 


75 


$25,000-$29,999 


9 


10 


97 


3 


5 


99 


14 


21 


96 


$30,000-$34,999 


2 


2 


99 


1 


1 


100 


2 


3 


99 


$35,000 or more 


1 


1 


100 


0 


0 


100 


1 


1 


100 


Not reported 


2 


— 


— 


0 


— 


. --- 


3 


— 


— 


Median 


$19,407 




$16,842 




$21,< 


630 
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Table 5 

Percentages Within Groups Reporting Various Activities 



Activity 


Fellows 

(N=95) 


Nonwinners 

(N=60) 


Deans 

(N=68) 


Significance 3 


Civic Affairs 


56 


70 


62 


None 


Lee tur ing 


83 


65 


76 


f/nw 


Consulting 


64 


48 


62 


f/nw 


Publishing 


35 


15 


22 


f/nw 


Serving as Mentor 


8 


2 


16 


d/nw 



a F /NW indicates a difference between Fellows and nonwinners significant 
at the .05 level.; D/NW indicates similar significant difference between deans 
and nonwinners. 
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careers, but even that would not be likely if the more qualified nominees 
were not being selected as Fellows. 

To clarify some of these points and to seek clues about how to 
improve the program, the two nominee groups (Fellows and nonwinners) were 
each divided into two subgroups: those who have become academic adminis- 

trators, in the sense of program objectives, and those who have not. The 
distinction, usual Ly obvious from the CSQ data, was based primarily on 
whether the person had in fact become an administrator of academic affairs 
beyond the level of department chairman; generally excluded were nonacademic 
administration positions and functions such as budgetary or fiscal officer, 
teaching faculty, and research faculty. In higher education, some people 
serve more than one function or hold special kinds of positions, resulting 
in some borderline cases. For present purposes, such people were usually 
judged to have arrived at positions consistent with program objectives* 

First, the research staff divided the 155 nominees who responded to the CSQ 
into groups on the basis of their present position, changes in positions 
over the past few years, and percentage of time spent in various functions; 
these classifications were reviewed by the staff of the Internship Program 
with virtually complete agreement about the resulting assignment of subjects 
to the four criterion groups. Although this procedure risks criterion con- 
tamination with respect to the internship status of the subject, it also 
ensures that the criterion group definition is consistent with program ob- 
jectives. Every effort was made to judge each case on the objective evidence 
in the CSQ and to do so consistently. 

Frequency distributions of the four career status groups defined by 
becoming or not becoming an academic administrator and by the fellowship sta- 
tus of the nominees are presented in Tables 5 and 7. Table 6 shows these 
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distributions for each program year and for the total sample of nominee 
respondents to the CSQ. Also shown are the percentages in each outcome 
group computed against the within-year grand totals, except that those 
corresponding to cell totals and marginal totals are based on the total of 
155 nominees. A condensed table for the total sample, with all three 
classes combined, is presented as Table 7. The overall relation between 
former internship status and current status as an academic administrator 
is shown by the correlational statistics presented with Table 7. 

The phi coefficient of .547 is very highly significant; the odds 
are less than one in a thousand that this result is attributable to random 
sampling errors. Conversion of this validity to an estimate of the intrin- 
sic validity of the program operations results in the very encouraging value 
of . 63 . 1 

If the evaluation and selection procedures have excluded those who 
do not later become administrators (Group D) and have accepted those who 
do (Group A), program objectives are being met. We may call these cases 
"hits." On this basis the general "betting average" for the program is 
77.5 percent (74.0, 76.3, and 78.4, respectively for the three classes). 

The 22.5 percent of the total sample from Groups B (Fellows who have not as 
yet become academic administrators) and C (nonwinners who are in academic 
administration) appear to be "misses." But this conclusion requires quali- 
fication. One must remember that Fellows and nonwinners differed in their 
response rates to the CSQ and that the total sample consists of respondents 
from three different classes. It is likely that enough time (about three 
years) has elapsed since the internship period of the first class so that we 
can assume that the first-year nominees are fairly firmly established in 
academic administration or in some other area, but the same may not be true 
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Table 6 

Distributions of Nominees into Outcome Groups 
(N = 155) 



Career Status 


Year of Program 


Fellows 


Nonwinners 




Total 


Have 




Group 

f 


A (Hits) 
% 


Group C 
f 


(Misses) 

7o 


f 


7o 


1st 


13 


37.1 


6 


17.1 


19 


54.2 


become 
















academic 


2nd 


32 


46.4 


4 


5.8 


36 


52.2 


administrators 


3rd 


27 


52.9 


2 


3.9 


29 


56.8 




Total 


72 


(46.5) 


12 


( 7.7) 


84 


(54.2) 


Have not 


1st 


Group 

f; 


B (Misses) 

% 


Group 

f 


D (Hits) 

% 


f 


% 


l 


2.9 


15 


42.9 


16 


45.8 


become 
















academic 


2nd 


12 


17.4 


21 


30.4 


33 


47.8 


administrators 


3rd 


10 


19.6 


12 


23.5 


22 


43.1 




Total 


23 


(14.8) 


48 


(31.0) 


71 


(44.8) 


TOTAL 


1st 


14 


40.0 


21 


60.0 


35 


22.6 




2nd 


44 


63.8 


25 


36.2 


69 


44.5 




3rd 


37 


72.5 


14 


27.5 


51 


32.9 




Total 


95 


(71.3) 


60 


(38.7) 


155 


(100.0) 



Percentages are computed against within year grant totals except in the lower 
right cell where percents are computed against total of 155 cases, as are the cell 
totals . 
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Table 7 

Condensed Outcome Table, All Classes Combined 
(N = 155) 



Outcome 



Statistic 



Fellows 



Nonwinners 



Total 



Have 

become 

academic 

administrators 



N 

'% of Administrators 
°/ 0 of Column Total 
% of Total 



Group A (Hits) 
72 

85.7 

75.8 
46.5 



Group C (Misses) 

12 84 

14.3 100.0 

20.0 

7.7 54.2 



Have not 
become 
academic 
adminis trators 



N 

% of Nonadminis- 
trators 



Group B (Misses) 
23 

32.4 



Group D (Hits) 

48 71 

67.6 100.0 



Total 



% of Column Total 
% of Total 

N 

% of Total 



24.2 

14.8 



95 

61.3 



80.0 

31.0 

60 

38.7 



45.8 



155 

100.0 



0 = .547 

j) max = . 864 
0/ 0 max = .633 

xl = 46.38 (p .001 with 1 df) 
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of those respondents in the second and third years of the program. As time 
passes, many of the respondents -- both Fellows and nonwinners -- who are 
not now academic administrators (Groups B and D) may move into that field. 
Conversely, the shift may be in the other direction: A person may try 

administrative work, for a while and then decide to return to research or 
teaching. With the passage of time, shifts from Group B to Group A will 
increase the ‘’betting average," while those from Group D into Group C will 
lower it. The net result may well be only a negligible change in the 77.5 
percent "hits" found to date. 

It is instructive to take a closer look at the apparent "misses." 

Those in Group B (former Fellows who have not yet fulfilled their promise) 
frequently indicated that they hoped and expected to take administrative 
positions during the next five years. One of the program objectives is to 
form a pool of identified potential administrators and to give them the 
special internship experience, rather than to fill existing vacancies on 
a crash basis. 

What about those in Group C, nominees who were not awarded an intern- 
ship but who already have become academic administrators? In any selection 
program, especially one with a pool of high-level nominees and a moderate 
selection ratio, one must expect to find some well qualified persons among 
the nonwinners. Moreover, being nominees, their interest in and potential 
for administrative functions had already been recognized at the home insti- 
tution. In spite of these considerations an attempt was made to ascertain 
whether these apparently inaccurate eliminations were occurring at the 
dossier or interview stages of evaluation. The results are equivocal. Of 
the twelve persons involved, six were from the first year of the program when 
the dossier screen was not used, four were from the second year of the program 
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and were interview eliminees, and the two remaining from the third year of 
the program were dossier eLiminees. 

Validation of Specific Evaluation and Selection Information 
Against Current Career Status 

The results presented in Tables 6 and 7 provide strong support for 
the overall validity of the operational program in meeting its objectives. 
Although prior reports have shown internal evidence of the relevance and 
validity of the specific information obtained and used during program oper- 
ations, the availability of career status followup data permits external 
validation of such specific information against achievement or nonachievemen t 
of status as an academic adminis trator . The criterion of "having arrived" 
carries no necessary connotation of high quality performance, but this may be 
presumed to some extent on the basis of anecdotal information available to 
program administrators, and on the previously cited indication of rapid 
career progression of former Fellows. 

It will be recalled that several kinds of ratings have been used: 

Home Evaluations, Dossier, Interview, and Confidential Reports. For a 
number of reasons the validities for specific items of information tend to 
be low. First, they can be computed only for those who returned the CSQ. 
Second, not all types of evaluations were used in all three years of the 
program or on all groups. In view of these and other technical problems, 
no attempt will be made to discuss validities in terms of statistical sig- 
nificance. Instead, we examine the patterns of validities with respect to 
their conformance with program objectives, to their agreement with previously 
reported results, and to their implications for possible improvement 
in evaluation and selection procedures. 
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For the latter purpose it will be useful to compare validities 
computed in the followup sample against the award/reject criterion with those 
against the career status criterion. Where the award/reject validites are 
markedly smaller than those for the career status criterion, the implication 
is that the item may be more useful or given greater weight in the program 
operations than has been the case. Conversely, where a validity against 
the award/reject criterion ?s greater than that against career status, the 
item may not be as important for selecting potential administrators as prior 
use suggests. Care must be taken, however, that such items are not rejected 
solely on this basis, because they may be measuring some attribute considered 
to be desirable in administrators, or because they may predict actual quality 
of administrative performance, rather than quick attainment of administrative 
status . 

Table 8 shows the validities of the Home Evaluation, Dossier, and 
Interview ratings for both the career status and the award/reject criteria. 
Although the validity of the Mean Dossier Rating (.12) and those of the 
Overall Rating (.11 for Home Evaluation and .19 f^r the Interviev?) against 
career status are very modest, the higher validity for the Overall Interview 
Rating suggests that the interview procedure is probably yielding unique 
information about a nominee's chances of later becoming an administrator. 

More important, finding some specific ratings to have higher, and some 
lower, validities against the career status than the validity of an Overall 
Rating indicates that improved evaluation would result if individual rating 
scales were given somewhat different emphasis than they now receive. In 
the case of the dossier, which consists in part of the Home Evaluation 
ratings, ten of the eleven subscales also used in the interview ratings may 
be getting too much weight. Only the Intelligence rating may be underweighted. 
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Table 8 

Point -Biserial Validities of Preinternship Ratings Against 
Acceptance/Rejection and Career Status Criteria 





Rating Scale 
Criterion 


Home Evaluation Ratings 


Interview Ratings 


Award Career Status 


Award Career Status 



Poise 


.18 


.06 


.24 


.25 


Extent of Speech 


- .10 


.11 


- .03 


- .09 


Quality of Speech 


.08 


.06 


.31 


.08 


Personal Appearance 


.11 


.01 


.24 


.11 


Aggression 


-.23 


- .15 


.12 


-.03 


Intelligence 


.12 


.22 


.30 


.12 


Cultural Level 


.02 


- .04 


.32 


.13 


Candor 


.21 


.06 


.23 


.19 


Enthusiasm 


.05 


.05 


.18 


.05 


Conviction 


-.16 


.06 


-.01 


-.07 


Ability in Interpersonal 
Relat ions 


.28 


.01 


.49 


.22 


Overall 


— 


.11 


— 


.30 


Dependabil ity 


.20 


.15 


— 


— 


. a 

Personality 


.28 


.05 


— 


— 


a 

Acceptability as Dean 


.17 


. 16 


— 


— 


a 

Administrative Knowledge 


.13 


.32 


— 


— 


Mean Dossier Rating 


.31 


.12 


— 


— 


a 

Signs of correlations 


reversed to 


compensate for 


reversed coding 


of scale 



on questionnaire. 
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It should be recalled that the raters at the home institutions understandably 
tend to give high ratings to the nominee. Moreover., each person is rated 
by some local standard rather than by comparison with the other nominees. 

The same limitations apply to the ratings on the other four scales. 
These scales are unique in the sense that they are not explicitly rated any- 
where else in the system. Two of them. Dependability and Acceptability as 
a Dean, are apparently given plausible weights in the dossier evaluation. 

The Personality rating appears to be overweighted. The previously reported 
correlation of .20 between the Administrative Knowledge rating with the 
Dossier rating and its present validity of .13 against the award criterion 
indicate that ratings on this scale are receiving some attention in the 
evaluation and selection process, but less than they should be, since these 
validities are smaller than for most of the other Home Evaluation ratings. 

Yet the rating on Administrative Knowledge has the largest validity (.32) 
against the career status criterion. Even in its present form it could 
probably be given greater weight in the Dossier evaluation. It would be 
possible to obtain this information directly from the nominees as part of 
the dossier (or interview) so that more meaningful score differences could 
be established among the nominees. Moreover, the present single item in- 
volves several related ideas about "knowledge and understanding of the func- 
tioning of an academic institution and relationships among its essential 
components -- faculty, students, administration, governing body." Thus, it 
might be useful to replace the single item with four separate items, one 
for each component . 

Validity coefficients were also computed for the other major portion 
of the dossier, the application form completed by the nominee. The useful- 
ness of the Undergraduate Grade Point Average was confirmed by correlations 
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of .16 against career status criterion and .12 against the award criterion. 

A subgroup of the sample were assistant deans at the time of nomination; 
the validities were .18 for career status and .11 for award. All other 
validities for information coded from the application form and computed 
against the career status criterion were of doubtful significance or inter- 
pretability. Nevertheless, much of this information bears on the quality 
of the nominee and is also useful in program administration. 

The previously demonstrated relationship between the interview 
ratings and the decision to grant an award is confirmed here, with essentially 
the same pattern of validities for the individual scales. The validities 
against the career status criterion, however, are generally lower, and the 
patterns are somewhat different. The validities of the interview ratings 
of Poise and Candor justify the attention currently given to these ratings, 
as does the validity of Ability in Interpersonal Relations, though to a 
lesser extent. But, perhaps too much emphasis is being given to Quality 
of Speech, Personal Appearance, Intelligence (in the interview situation) 
and Cultural Level. But here again, caution is indicated because these may 
well be desirable traits in those who are selected and eventually become 
academic administrators, regardless of whether they predict early attainment 
of such career status. 



Validities of the Confidential Report Ratings 
In contrast to the ratings of various traits and behaviors obtained 
in evaluating nominees and used in selecting Fellows, the Confidential Re- 
ports of Intern Performance emphasize actual growth and performance of the 
Fellow during his internship, as evaluated by his mentor and other persons 
at the host institution. The two traits of Initiative and Persistence are 
not rated in the evaluation and selection procedures and the Overall rating 
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is directly relevant to administrative ability as demonstrated during the 
internship. Many of the Confidential Report ratings bear on later expecta- 
tions about the qual i ty of future performance in specific academic positions. 
Such considerations may account for the lack of a demonstrable relationship 
of the Dossier and Interview Ratings with the Confidential Report ratings. 
Moreover, as in the case of the Home Evaluation ratings, each person is 
rated locally rather than in comparison with the other nominees. The validi- 
ties of the Confidential Report ratings against the career status criterion 
are presented in Table 9 with the corresponding validities against the 
Overall Rating of Admini s tra t ive Ability as demonstrated during the intern- 
ship . 

Against the Career status criterion, the Overall rating had only 
minimal validity as did the ratings of Administrative Judgment .rnd Achieve- 
mer *• ' Specific Assignments. In contrast, the higher validity of ratings 

on th During Internship are encouraging, since they suggest that the 

internship experience is having a positive impact on the Fellow. Particularly 
impressive is the relatively high validity of the ratings on Persistence; 
obviously some attempt should be made to obtain such a rating during the 
evaluation and selection procedures, and perhaps even in the Home Evalua- 
tions. Validities (not shown) for ratings about relations with various kinds 
of academic personnel were systematically negligible or spurious. The dif- 
ficulty, as previously reported, is that contacts between Fellows and other 
academic persons cannot easily be observed with sufficient consistency to 
permit reliable ratings. 

Another part of the Confidential Report asked the rater whether he 
would have recommended the subject both for an internship and to fill an 
appropriate administrative vacancy; the correlation between these two items 
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Table 9 

Point-Biserial Validities of Confidential Report Ratings Against 
Career Status Criterion and Against Overall CR Rating 3 



CR Rating Scale Career 


Status Validity 


Overall Rating Validity 


Administrative Judgment 


.12 


.80 


Achievement of Specific Assignments 


.17 


.68 


Growth During Internship 


.19 


.65 


Initiative 


.15 


.74 


Persistence 


.32 


.68 


Overall Administrative Ability 


.14 


— 


Would have recommended for: 






Internship 


.24 


.74 


Filling Administrative Vacancy 


.18 


.70 


Would Expect Quality Performance as: 






Department Chairman 


.03 


.54 


President of Small College 


.15 


.67 


President of Junior College 


.18 


.48 


President of Large University 


.03 


.50 


Academic Vice-President 


.19 


.67 


Academic Dean 


.11 


.60 


Dean of Students 


.02 


.13 


Chief Budget Officer 


-.12 


.14 


Chief Development Officer 


.21 


.29 


Distinguished Professor 


.02 


.34 


Mean Dossier Rating 


.02 


.14 


Overall Interview Rating 


- .09 


.08 
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was previously demonstrated to be very high* High ratings on these items 
imply an approval of the selection of the ratee as a Fellow. It is there- 
fore somewhat encouraging to find that these items have appreciable validi- 
ties against the career status criterion. Moreover, allowing for fluctua- 
tions to be expected in these coefficients, the pattern of validities for 
expectations of future performance in various administrative positions is 
also encouraging. In short, these ratings of Fellows after their internship 
has been completed are not only indicative of successful selection, but also 
of future achievement of administrative career positions. 

The general picture given by the validities of the Confidential 
Report ratings, taken in conjunction with the low relationship to the evalua- 
tion and selection procedures, indicates that something is happening in tne 
internship situation that is helpful to the achievement of career status as 
an academic administrator. The comments of both Fellows and mentors, pre- 
viously summarized, on the values of internship to them as persons and to 
the host institutions enhances this picture. 

The overall validity of the program demonstrated by the data 
presented in Tables 6 and 7 combines the validity of initial selection of 
FelLows with the validity of the internship experience for those who were 
selected. The same consideration applies to the validities of the specific 
evaluation and selection variables, because only those nominees selected 
have the opportunity to be affected by the internship experience. It is, 
of course, a matter of considerable interest to the program to be able to 
separate the effects of the internship experience from those of the selection 
and evaluation process. Therefore, two kinds of analyses were undertaken to 
effect this separation and to provide some indication of the relative impact 
of the two phases of the program. 
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In the first analysis, some indication of the effect of the intern- 
ship experience per se can be seen by comparing the validity of the Confiden- 
tial Report ratings based on performance and growth during the internship 
with the validity of the selection variables within the group of selected 
Fellows. If the greater likelihood that Fellows will become administrators 
is primarily a function of selection, the validities of the selection variables 
should be of a similar magnitude to, or greater than the validities of the 
Confidential Report Ratings. Conversely, if the internship experience 
increases the probability of a Fellows' becoming an administrator, the 

validities of the mentor ratings should be not only positive, but also 

2 

greater than those for the selection variables. 

The validities of the dossier and overall interview ratingr com- 
puted within the group of Fellows, are given at the bottom of Table 9. That 
the Confidential Report ratings have higher validities supports the hypothesis 
that the internship experience increases the probability of early attainment 
of administrative status. The negative correlation (within the selected group 
of Fellows) for the interview rating suggests that the internship experience 
may be more beneficial to those judged in the interview to be acceptable 
but not outstanding, possibly because they have more ’’room to grow.” 

In the second analysis, using all available data on the total nominee 
group, the multiple correlation of each set of variables was compared with that 
computed using both the selection variables and the Confidential Report Ratings . 
The result is a multiple correlation of .64 for the combined effects of selec- 
tion and of the internship experience, a result which agrees closely with the 
intrinsic relationship (.63) estimated from the data in Table 7. We also find 
a multiple correlation of .25 for the selection variables (Dossier and In- 
terview ratings), and a multiple correlation of .43 for the mentor ratings 
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in the postinternship Confidential Reports. The latter emphasized the 
Overall rating of the Fellow's internship performance and his grox^th during 
the internship. 

Thus the two methods for separating the impact of the internship 
experience from that of the selection process agree in their indication that 
the internship experience itself has favorable effects, not wholly attribu- 
table to the selection process. Moreover, the results of the second method 
show that both the selection process and the internship experience contribute 
to a successful outcome, but that the internship experience may be the stronger 
of the two contributions (.43 versus .25, cited above). Nevertheless, one 
should remember that these results are computed on the nominee group after 
the Home Evaluations have been made and selection for nomination has 
occurred. Moreover, the evidence shows that the evaluation and selection 
process also plays a significant role in the total program. The large 
increase in multiple correlation that results from combining information 
from both selection and internship experience results, in part, from these 
two aspects of the program accomplishing two different goals and, as pre- 
viously mentioned, there is little relationship between the preinternship 
evaluation variables and the pos t internship ratings of the Fellow r s growth 
and performance during his internship experience. 

With this particular criterion for validation, it is possible 
that the apparently strong effect of the internship experience means that 
the Fellows, not only because they were selected but also because their 
qualities were apparent to their mentors, have very rapidly become highly 
visible as potential academic administrators. WhiLe nota part of the 
program design, visibility is consistent with program objectives. 
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Summary and Conclusions 

The results of the research done on the internship program, es- 
pecially those of the present followup validation, justify the conclusion 
that the ACE Academic Administration Internship Program has been highly 
successful in meeting its objectives of identifying and selecting persons 
qualified to form a pool of potential academic administrators and in provi- 
ding those selected with a developmental experience designed to enhance 
their potential. The most direct and convincing evidence of the overall 
validity (.63) of program operations consists of the high rate of early 
attainment of status as academic administrators by former Fellows as compared 
with the rate for nonwinners. Although it is technically difficult to separ- 
ate the effects of evaluation and selection from the impact of the internship 
experience, the evidence indicates that each stage of the operation contri- 
butes to meeting the program objectives. For example, a multiple correlation 
of .25 was obtained for the evaluation and selection variables against the 
career status criterion, and of .43 for the Confidential Report ratings of 
performance and growth during the internship. 

On those characteristics deemed desirable in academic administrators, 
nominees were typically superior to control subjects who were not nominated 
for the program; Fellows were superior to nonwinners on the followup career 
status criterion, and they had become Fellows by virtue of their higher 
dossier and interview ratings. Moreover, the Fellows have almost invariably 
reported that the internship experience helped in their development, and 
their mentors have said that the Fellow's sojourn on campus was of value to 
the host institution. 

These findings should be supplemented with systematic followups 
five years after the internship for each class to ascertain how far they have 
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progressed in their careers. Unfortunately, direct, unbiased information 
about the quality of the on-the-job performance of administrators, whether 
or not they had been Fellows, is difficult to obtain. Although one might 
ask presidents, administrative peers, and faculty members to rate such 
performance, the ratings would be of doubtful value. Actually, further 
career progress with respect to administrative rank, or even retention at 
ranks of academic dean or higher, is some evidence of quality. 

The research program, though it has provided validation of the 
internship program, has resulted in little by way of suggested improvements. 
In part this is a reflection of the success of the operational program. 

It is easy enough to suggest new and relevant items, but most of them would 
cover information already available elsewhere in the program operations. 

The present study did indicate some need to create a small pool of items 
that would measure the nominee’s specific administrative knowledge, and 
some need to obtain an early rating of persistence as a personality trait, 
either in the Home Evaluations or as a part of the dossier. 

Beyond the general finding of a high intrinsic correlation (.63) 
between selection and experience as a Fellow, and early attainment of a 
career position as an academic administrator, a number of more specific 
summary statements can be made with respect to the successive stages of 
the internship program. The statements are based in part on those research 
results previously reported, and in part on those presented in this followup 
s tudy . 



1* The nomination stage . Participation in the program by public 
institutions and universities has been proportionately greater than that by 
liberal arts, two-year, and church-related colleges, or by technical insti- 
tutions. As measured by summary statistics on characteristics deemed desirable 
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in academic administrators, nominees have been of high quality; in fact, 
their quality improved in the third year of the program, after its aims 
were better understood. This high quality of the nominee groups has made 
subsequent evaluation and selection more difficult, but also more efficient. 

Even though home institution ratings of nominees tend to be high, 
thus limiting their value, the Home Evaluation ratings have useful validity 
and are generally given, appropriate weights in evaluating the dossier of 
which they are a part. Greater weight might be given to specific kinds of 
administrative knowledge and to persistence as a personality trait, 

2. The dos s ie r evaluation s tage . Information pertaining to 
past scholarly achievement or to administrative experience contributes most 
directly to the dossier ratings of nominees. These ratings predict the 
results of the interview stage of evaluation and therefore have been 
successfully used as a prescreening device. The Mean Dossier Rating has, 
however, only a modest validity against the career status criterion. 

3. The interview stage . The final decision to award an intern- 
ship is most directly related to the Overall Interview Rating, which has 

been affected by the previous evaluations. The overall rating has appreciable 
validity against the career status criterion; since this validity is higher 
than those usually observed for evaluations at earlier stages, the interviews 
are yielding unique information that has a definite bearing on the chances 
of a nominee’s becoming an administrator. The validities of some of the 
individual rating scales are higher than those computed against the award 
decision. Such results indicate that some shift in emphasis might be given 
to the various traits rated in the interview. Moreover, an overall rating 
is less efficient than ratings on the most valid of the specific items. 

Since all nominees are considered in the selection process, evaluations 
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are best obtained from dossier and interview ratings, where the judges can 
compare nominees with each other on a uniform standard. If the qualities 
considered desirable in an academic administrator are to be considered the 
primary criteria in achieving the program objectives, then it would probably 
be unwise to change the existing procedures. If, on the other hand, early 
attainment of academic adm .mis trative status is at least one desirable out- 
come of the program, less emphasis should be given to personal appearance, 
quality of speech, and recent scholarly productions, and more emphasis should 
be placed on a nominee’s specific knowledge and understanding of the func- 
tioning and interrelations among the components of an academic institution. 

4. The internship experience . Since only those selected as Fellows 
have the opportunity for the internship experience, it is difficult to separ- 
ate the effects of successful evaluation and selection from any impact of 
the internship experience itself. As previously noted, both the Fellows and 
their mentors emphasize the positive values of the internship, each from 
their own viewpoints. Little research has been done, however, on the content 
of the internship experience, or how it might be improved. The Fellows offer 
generally favorable comments, but they do not agree on what specific activi- 
ties are most usefuL in their growth, though they emphasize the broadening 
of out Look on both academic and civic matters that results from contact 
with new people and new ideas. 

We do find higher validities within the group of Fellows for the 
Confidential Reports of performance and growth during the internship than 
for the selection variables. Using a somewhat different approach, we find 
multiple correlations of .25 for the preinternship evaluation variables used 
in the selection of Fellows, .43 for Confidential Report ratings of performance 
and growth during the internship, and .64 for the two sets of variables 
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combined . These results strongly suggest that both the selection process 
and the internship experience play their respective roles in the program. 

The selection process identifies the pool of potential academic administrators, 
and the internship experience provides opportunities for Fellows to develop 
that potential, with the result that they rapidly achieve career status as 
academic administrators. 

The ACE Academic Administration Internship Program may be judged 
as a successful venture justifying its initiation, The Ford Foundation's 
funding, and the support it has continually received from the presidents 
of participating institutions and from the Fellows themselves, who are 
probably the most direct beneficiaries. Less tangible are the long-range 
effects of such a program. But it seems to be supplying a pool of qualified 
administrative talent in a time of rapid challenges and changes in academia. 
Perhaps it is some of these able, younger men and women, familiar with the 
past but not enslaved by it, who will provide academic leadership in critical 
areas . 
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Technical Footnotes 



1 , 



This statement is based on the conversion of the phi coefficient 



to the chi-square statistic of 46.38 (shown in Table 7) for which probabil- 
ity tables are available. The phi coefficient measures the actual, extrin- 
sic relationship, useful if one is primarily interested in prediction; 
its maximum value is restricted by unequal marginal totals, in this case 
to .86. Division of phi by this maximum value yields an estimate of the 
intrinsic relationship on the more familiar scale of correlation, resulting 
in a coefficient of .63. 



tion with those of the impact of the internship experience is that it sup- 
presses the influence of the selection variables. Ideally, all of the 
validity coefficients should be corrected for effects of the selection 
process to obtain an estimate of impact if all nominees had gone through 
the internship experience. Unf or tunateLy , no sound procedure is available 
for doing this in the case of a dichotomous criterion where predictor vari- 
ables are not normally distributed and selection is not based on a direct 
cutoff score. The validities of the selection variables are more drastically 
affected by the selection process than are the Confidential Report ratings. 



The multiple correlations were computed using an adaptation of the BIOMED 



program 02R, with an input correlation matrix computed using BIOMED program 03D , 
which allows for missing data. Thus, all available data on selection variables, 
for the nominees who returned the CSQ, and all matching data for the subgroup 
who became Fellows, were used. This procedure probably introduces some dis- 
tortions, largely unknown, in the mathematical properties of the system of 
intercorrelations, but makes possible the computation of the multiple corre- 
O lations required. 



2 



One objection to this method of comparing the effects of selec- 
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Extensive questionnaires were administered to nominees, both 
Fellows and nonwinners, before and after the internship program. These 
questionnaires consisted of self-reports of opinions, interests, skills, 
traits, and activities. The resulting information was never used in the 
operational program, but solely in research designed to identify items 
which might add validity to the selection procedures, or which might indicate 
more specific changes occurring over time. Although some valid items were 
found (53 out of 374 validities against the career status criterion were 
in the .12 - .28 range), corresponding validities against the award criterion 
were as high or higher. This indicates that the valid content in the item 
was already implicitly available in the evaluation and selection procedures. 

The few exceptional items which were valid against the career 
status criterion, but unrelated to the award criterion, and with face rele- 
vance to program objectives included self-ratings on Leadership, Social Self- 
confidence, and Ability as an Extemporaneous Speaker. In addition, similar 
validity patterns were found for self-ratings of strengths in General 
Administra -ive Ability, Knowledge of Students, and Knowledge of Faculty. 

Again, there is a suggestion that administrative knowledge might better 
be measured by having all nominees answer a small pool of items rather than 
using a single Home Evaluation rating. 

In summary, the extensive search for items to improve the evaluation 
and selection procedures has resulted in a very small pool that might consti- 
tute a one-page nominee questionnaire to be included in the dossier. Since 
these results have not been cros s-val idated , such items should be used con- 
servatively in evaluation. 
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ACADEMIC ADMINISTRATION INTERNSHIP PROGRAM 
of the American Council on Education 



CAREER STATUS QUESTIONNAIRE 



In 1965 the American Council on Education initiated an internship program designed to identify 
persons interested and capable of becoming academic administrators, and to provide a selected group of 
the persons so identified with special experiences relevant to their professional development. As a part 
of the Council’s efforts to evaluate this program, we seek information regarding the present car er status 
of former candidates, and of former participants in an Academic Deans Institute. Whether or not you were 
among those who actually held a Council internship, we would appreciate your completing and returning 
this short questionnaire at your earliest convenience. Your response will be treated as confidential informa- 
tion, A self-addressed envelope is enclosed for your convenience in returning your completed questionnaire. 



Sincerely. 






Logan Wilson 
President 



1 . Your name (please print) 

LAST MRST MIDDLE OR MAIDEN 



2, Your present institution 

NAME OE INSTITUTION STATE 

3. Did you complete an ACE Academic Internship? (circle one) 

Yes, in academic year 1965-66 1 

Yes, in academic year 1966-67 2 

Yes. in academic year 1967-68 3 

No, but participated in an ACE Academic Deans Institute 4 

No. but participated in some other academic management development 

program, under other sponsorship 5 

No, 1 have had no such experience 6 
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4. Which of the following academic positions do you now hold? Have you held in the past? 



(Circle one in each column) 



Position I 
hold now 



Position I 
held three 
years ago 



Position I 
held five 
years ago 



Department chairman 

President of a small 4-year college or branch campus of 
a '‘system” 

President of a junior college or 2-year branch campus. . . 

President of a large university or “system” 

Academic vice-president or provost 

Academic dean 

Dean of students 

Chief fiscal or business officer 

Chief development officer 

Full professor 

Associate or assistant professor 

Other or none 



2 

2 

2 

2 

2 

2 

2 

2 

2 

2 

2 



2 

2 

2 

2 

2 

2 

2 

2 

2 

2 

2 

n 



2 

2 

2 

2 

2 

2 

2 

2 

2 

2 

2 

2 



5. 



How often do you participate in decision-making in the following 



Area of Decision Frequently 

Admissions policies 3 

Faculty personnel policies 3 

Financial affairs and capital improvements 3 

Student affairs 3 

Formal public and alumni relations 3 

Individual course content 3 

Curriculum structure 3 



areas? (Circle one in each row) 
Occasionally Rarely 



2 1 
2 1 
2 1 
2 1 
2 1 
2 1 
2 1 




& 






6. During the 1968-1969 academic year, what portion of your time was spent in each of the 
following problem areas? What was the extent of your personal concern and interest? 



Fill in Indicate degree of personal interest 

Problem percent time and concern 

spent ( Circle one in each row) 



Faculty relations 




High 

3 


Medium 

2 


Low 

1 


Budget 




3 


2 


1 


Curriculum 




3 


2 


1 


Physical plant 




3 


2 


1 


Community and public relations 




3 


2 


1 


Student unrest 




3 


2 


1 


Other student personnel 




3 


2 


1 


Development (including fund-raising) .... 




3 


2 


1 


Financial aid (fellowships, scholarships, 

and loans) 




3 


2 


1 


Alumni relations 




3 


2 


1 


Administrative coordination 




3 


2 


1 


Institution research or program 

planning 




3 


2 


l 


Internship matters (including serving as 

mentor) 




3 


2 


1 


Teaching courses 




3 


2 


1 


Doing research 




3 


2 


1 


Administering research 




3 


2 


1 


Other 




3 


2 


1 




100% 
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7. What is your annual salary before taxes, exclusive of fringe benefits, consulting and lecture 
fees? ( Circle one) 



Less than SI 0,000 , . . . 1 

$10,000-$ 14,999 ... 2 

$15,000-519,999 .... 3 

$20,000-524,999 .... 4 

$25,000-529,999 . . .5 

$30,000-$34,999 ... 6 

$35,000 or more .... 7 



8. Which of the following have you done during the last two years? (Circle as many as apply) 



Served on local civic or political committee 2 

Gave address or lecture with remuneration 2 

Served as consultant on issues in higher education 2 

Published on one or more administrative or policy issues in higher education 2 

Served as a mentor to an academic intern 2 



9. What role, and in what type of institution, do you expect to be playing in higher education 
five years from now? 



10. (For former interns only) In the light of your subsequent experience, what aspects of your 

internship experience were most valuable? Least valuable? What changes in that experience 
would enhance its value for the intern’s subsequent academic roles? 

Most valuable: 



Least valuable: 



Recommended changes: 





JUNE 1969 
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